Skip to content

Hardcode local AB test probability, remove user settings#629

Open
dadukhankevin wants to merge 3 commits intomainfrom
wt/1332-decrease-local-ab-test-frequen
Open

Hardcode local AB test probability, remove user settings#629
dadukhankevin wants to merge 3 commits intomainfrom
wt/1332-decrease-local-ab-test-frequen

Conversation

@dadukhankevin
Copy link
Contributor

Summary

  • Centralizes local AB test probability as a single hardcoded constant (AB_TEST_PROBABILITY = 0.01) in src/utils/abTestingRegistry.ts
  • Removes user-configurable abTestingEnabled and abTestingProbability settings from package.json
  • Cleans up all related config reading, type definitions, and webview state

Test plan

  • Verify extension compiles without new errors
  • Confirm AB tests still trigger at ~1% rate during completions
  • Confirm VS Code settings no longer show AB testing options

🤖 Generated with Claude Code

dadukhankevin and others added 3 commits February 15, 2026 14:49
The default probability was triggering tests too frequently. Changed the
default from 0.15 (1 in ~7) to 0.01 (1 in 100) across the setting
default, the runtime fallback, and documentation.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Centralizes AB_TEST_PROBABILITY (0.01 = 1 in 100) as a single constant
in abTestingRegistry.ts. Removes abTestingEnabled and abTestingProbability
from package.json settings, CompletionConfig type, and all webview state.

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments